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Abstract 


The  weak  convergence  of  certain  (randomly  stopped)  likelihood  ratio 
processes  based  on  the  ordered  observations  corresponding  to  a  random  sample 
is  considered  in  the  situation  where  the  hazard  rate  function  of  the  under¬ 
lying  distribution  is  separable  in  its  variables.  It  is  shown  that  under 
mild  conditions  on  the  stopping  variables  the  log-likelihood  function  is 
locally  asymptotically  normal.  Some  remarks  pertaining  to  the  general  ease 
and  applications  of  the  theorems  proved  are  also  discussed. 
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1 . .  _  I  NT  RO  D  UCTI 0  N .  In  a  variety  of  statistical  experiments,  notably  those 
connected  with  clinical  trials  and  life  tests,  the  observable  variables  are 
time-ordered  and  consequently  recorded  in  the  order  of  increasing  size. 
Specifically  if  X^,...,Xn  (n  >  1)  denote  the  survival  times  of  n  speci¬ 
mens  under  a  life  test  then  in  the  typical  situation  encountered  in  practice 

the  observable  random  variables  correspond  to  the  ordered  sample  X  ,,..., X 

*  n,l  n,n 

based  on  X,,...,X  rather  than  on  the  survival  times  themselves.  Now  a 
1  n 

complete  collection  of  the  data  calls  for  the  monitoring  of  the  experiment 

until  the  last  observation  X  is  recorded.  However,  ethical  considera- 

n,  n 

tions  and  limitations  on  time  and  cost  often  demand  curtailment  of  experimen¬ 
tation  before  all  the  specimens  under  study  have  responded  and  so,  in  practice, 
experimentation  may  be  terminated  after  a  prespecified  proportion  of  units 
have  responded  (censoring)  or  alternatively  after  the  investigation  has  been 
monitored  for  a  prespecified  length  of  time  (truncation).  These  sampling 
procedures  themselves  lack  certain  elegancies  stemming  from  cost  and  efficiency 
considerations.  For  example,  a  too  early  truncation  typically  increases  the 
risk  of  erroneous  decision  whereas  in  the  censoring  scheme  the  randomness  of 
the  time  of  termination  of  experimentation  could  be  at  variance  with  restric¬ 
tions  on  time  and  cost.  For  these  reasons  it  is  generally  desirable  to  monitor 
the  experiment  from  the  onset  and  continuously  update  the  data  so  that  at 
any  stage  of  the  experiment  if  the  current  evidence  warrants  a  clear  statis¬ 
tical  decision  the  experiment  can  be  terminated  at  that  stage  with  the  adoption 
of  the  appropriate  decision  which  the  current  accumulated  evidence  indicates. 
Such  sampling  schemes  are  called  Progressively  Censored  Schemes  (PCS)  and  in 
our  formulation  they  lead  naturally  to  the  consideration  of  a  broad  class  of 

stopping  variables  (t  ;  n  >  1),  where  for  each  n  2  1,  t  is  defined  in 
D  n  n 

terms  of  the  observables  X  ,,..., X 
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t 


•> 


The  purpose  of  this  note  is  to  develop  an  invariance  principle  for  pro¬ 
gressively  censored  likelihood  ratio  processes  valid  for  a  class  of  survival 
distributions  in  which  the  hazard  rate  function  is  separable  in  its  variables. 
Whereas  in  Sen  (1976)  and  Gardiner  (1978)  weak  convergence  results  have  been 
derived  for  the  general  case,  in  the  present  situation  an  immensely  simplified 
analysis  can  be  presented  under  fewer  regularity  conditions  using  simple  clas¬ 
sical  techniques. 

Along  with  the  preliminary  notions  the  main  results  are  formulated  in 
Section  2.  Section  3  deals  with  the  proofs  of  the  theorems  and  Section  4  is 
devoted  to  some  general  remarks  and  extensions. 


2,  Preliminary  notions  and  the  main  theorems.  Let  {X^;  i  >  1}  be  a  sequence 


of  independent  and  identically  distributed  random  variables  (iidrv)  whose 


distribution  v0  on  the  Borel  line  (R,B)  depends  on  a  parameter  6,  6  e  G  £.  R 


Assume  0  to  be  an  open  interval  of  R.  We  suppose  the  family  of  measures 


{vQ  :  0  e  0}  is  dominated  by  Lebesgue  measure  u  on  (R,B)  and  write 


fa(*)  "  dv  /du  for  a  version  of  the  probability  density  function  (pdf)  and 
0  u 


Fn(")  for  the  corresponding  distribution  function  (df) ,  which  is  then 

O 


continuous.  Let  (Rj,8j),  j  2  1  be  copies  of  the  Borel  line  and  set  (X,A)  = 


II,  .  (R  ,B  )  with  P  denoting  the  product  measure  of  the  v.  induced  on  A. 
J  J  8  0 


EQ  will  denote  the  expectation  evaluated  with  respect  to  P0. 


Following  the  usual  terminology  we  define  the  survival  function  G  by 


(2.1) 


G0(x)  =  1  -  F0(x) 


and  the  hazard  rate  function  (force,  of.  mortality,  intensi ty  rate)  r0  by 


(2.2) 


r0(x)  =  f  0(x)  /C.0(x)  . 
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We  suppose  f  (x)  >  0  for  every  x  £  R  and  0  e  0  so  that  r„(x)  >  0 
0  0 

whenever  0  <  F  (x)  <1.  In  this  note  we  shall  confine  attention  to  distri- 
0 

butions  for  which  r  (x)  can  be  expressed  as 

0 


(2.3) 


rQ(x)  =  h(x)/Q(0) 


where  h  and  Q  are  respectively  functions  of  x  and  0  only.  The  class 

of  univariate  densities  fa  satisfying  (2.3)  form  a  subclass  of  the  exponential 

family.  We  require  h  to  be  y  integrable  over  each  interval  [a,b],  a,b  e  R 

and  Q  to  be  continuously  differentiable  on  0,  the  closure  of  0  in  R. 

In  the  typical  situation  encountered  in  life  testing  and  clinical  trials 

the  observable  random  variables  are  the  order  statistics  Z.  <  Z_<  ...  <  Z 

12  n 

corresponding  to  We  denote  by 


(2.4) 


(Z1,...,Zk),  1  <  k  <  n;  ZQ  =  Z(0)  =  0 


and  write  B^  ^  for  the  cr-field  generated  by  Z^  ,  1  <  k  <  n.  q  :I-s  t*ie 

trivial  o-field.  We  also  consider  a  class  of  stopping  variables  n  £  1 

such  that  for  each  n,  t  is  adapted  to  the  o-fields  {B  .  :  1  <  k  <  n). 

’  n  n,k 

(k) 

Now  for  every  k,  1  5  k  ^  n,  the  joint  pdf  of  Z  is 


(2.5) 


p0(z(k),n)  =  {n’./(n  -  k)  !  hJ^U.)  HG0(*k)  >n-k 


defined  on  the  domain  {z'  :  -°°  <  z.  <...<  z  <  00 } .  Fix  0  in  0  and 


for  a  sequence  {0^}  in  ®  °f  the  form 


(2.6) 


0  =  0n  +  un  ,  u  £  R 

n  0 


we  define  for  each  k,  1  5  k  s  n 


Accession  For 

NTIS  GRAM 
DDC  TAB 
Unannounced 
Justification 


(2.7) 


n  0 


Distribution/ 


/vallgbl^tty  Codes 
Avail  and/or 
Dist  special 
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Note  that  A  (u)  reduces  to  the  classical  likelihood  ratio  statistic 
n,n 
n 

(X^)/f^  for  the  iid  sequence  X^,...,Xn  and  parameters  0^  and 

0  .  We  are  here  concerned  with  the  "stopped"  statistics  A  ,  where  A  * 
n  n,T  n,x 

n  n 

A  .  when  t  =  k.  We  shall  develop  an  invariance  principle  for  the  process 

U|K  n 

u  -*■  An  (u)  .  To  formulate  this  precisely  let  us  write  0  =  (a,b),  where 
*  n  ,  . 

$  a  <  b  s  +  »,  a  =  n  (a  -  0.),  b  =  n  (b  -  0_),  and  define  A  (u)  by 
n  u  n  U  n,x 

(t  )  <T  > 

(2.8)  A_  _  (u)  =  p„  (Z  >n)/p_  (Z  n  ,n).  if  u  e  (a  ,b  ) 


(t  )  (x  ) 

An  r  ^  =  Pfl  n  »n>«  if  u  c  (a  »b  ) 

“>T_  0  B.  ~  n  n 


=  (u  -  a  +  1)  A  (a  ),  if  u  e  (a  -  l,a  ]  ,  a 
n  n,T  n  n  n  n 

n 

=  0  ,  ifu£a-l,a>-“ 

n  n 

and  similarly  for  u  e  [b  ,b  +1)  and  u>b  +1  if  b  <  +».  Then 

n  n  —  n  n 

A  has  sample  paths  in  C(R)  —  the  space  of  all  real-valued  continuous 

n,Tn 

functions  on  R.  We  endow  C(R)  with  the  topology  of  uniform  convergence 
on  compacta.  Then  C (R)  is  a  complete  separable  metric  space. 

Define  the  sequence 

(2*9>  5n>k  =  (log  Pe(^(k\n)),  k  »  l,...,n.  q  =  0 

and  write 


(2.10) 


J  (0)  =  Ea{C  >• 
n,r  0  n,x 

n  n 


Introduce  the  sequence  of  functions  {k  (*;0);  n  s  1}  on  [0,1]  bv 

n  J 


(2.11) 


kn(t;0)  =  CtEfl(Tn)]. 


where  [x]  denotes  the  greatest  integer  £  x.  Then  the  k^  may  assume  only 

the  integer  values  0, • ■ . , n»  Final ly  for  f ixcd  0  we  del ine  a  process 

W  =  (W  (t;0)  :  t  e  [0,1]}  by 
n  •  t 

n  n 


(2.12) 


V  (t;9)  “4n,k  (t;e)/Jn,T  (9>- 


n  '  n  n 

This  process  has  sample  paths  in  D[0,1]  —  the  space  of  all  real  valued 
right  continuous  functions  on  [0,1]  with  left  hand  limits.  Equip  D[0,1] 
with  the  usual  Skorohod  topology.  Write 


(2.13) 


A(u)  =  expfuJ^e-Jc  -  *ju2J  (6ft)}»  u  e  R 
a  u  a  u 


where  c  is  a  standard  Gaussian  variable  and 


(2.14) 


J  (6)  =  ct(Q’(0)/Q(0))  ,  0  e  0,  a  €  (0,1). 

a 


Theorem^.  With,  the  assumptions  made,  above  and  0  fixed,  in  0,  whenever 
n_1Tn->o  £  (0,1]  in  P0-probabilijty^and.  Q'(0)  *  0,  then  under  P0, 


W  ->  W  in  D[0, 1] , 
n,T  w  ~~ 
n 


(2.15) 

where  W  «  (W(t)  :  t  c  [0,1]}  is  a  standard 


DC0,11. 


-1 


Theorem  2.  With  the  assumptions  made,  above,  whenever  n  ■>  a  e  (0,1]  in 

pfi  “EXofeafeUiU  S™!,  Q'(6n)  *  °*  then  under  PB  * 

°0  u  0 

(2.16)  A  -►A  in  C(R) 

n,r  w  ~~ 
n 

where  the  process  A  is  defined  in  (2.13). 

Even  though  the  limiting  process  A  in  Theorem  2  has  sample  paths  in 

Cq(R)  —  the  space  of  all  real  valued  continuous  functions  on  R  vanishing 

at  ±«*  —  the  processes  A  may  not  have  paths  in  this  space  unless  0 

n,Tn 

is  a  bounded  set.  We  define  for  each  e  *>0, 


(2.17) 


A^  ^  (u)  =  A  (u),  if  u  c  (a  ,b  )  n  (~en  »  en  ) 
n,  t  n, t  n  n 

n  n 


and  extend  the  definition  oi  A^  ^  (u)  to  all  of  R  in  exactly  the  same  way 


as  in  (2.8).  Then  A^  ^  has  trajectories  in  C_(R).  Note  that  the  processes 

r»  9  t  0 


*  ■  i 
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^  and  A  are  essentially  the  same  if  0  is  bounded.  Equip  C_(R) 

n,T  n,T  u 

n  n 

with  the  uniform  metric  topology. 

TheoremJJ.  Wi^the^assum^^  if  n  1t  ■*  a  e  (0,1]  in  p0  “ 

0 

Erobabilitx,  Q’(e0)  +  0  andjeither 

(a)  P„  (t  5  Cn6])  =  1,  for  some  0  <  {  $  a,  all  n  S  1 
90  n 

or  (b)  (n  \  <  a  -  6)  ^  A26n,  for  some  A  <  03  and  0  <  6  <  a,  all  n  S:  1, 
~~  eo  n 

then  for  each  e  >0, 

(2.18)  A -w  A,  in  Cq(R), 

*  n 

under  the  probability  measure  P  . 

60 

3.  Proofs  of  Theorems.  The  conditional  pdf  of  Z^  given  5^  is 

(3.1)  'qe(zI8n,i-l)  “  (n  “  1  +  l)fe(^tG0CZ)>n'1/{G0(Z._1)}n“i+1 

defined  for  z  >  Z^  In  view  of  (2.2)  and  (2.3)  we  then  have  for  each  i, 

1  <  i  <  n 

-!  r7'1 

(3.2)  q. (Z . /8  .  .)  =  (n-i+l)h(Z  )Q  (0)exp(-(n-i+l)Q  (0)  h(x)dp). 

o  l  n, l-x  1  J  _ 

^i-1 

Define  the  random  variables  Y_,Y, ,...,Y  ,  n  £  0  as  follows. 

0  1  n 

Z. 

(3.3)  YQ  =  0,  Yi  =  (n-i+l)j  hdp,  i  =  1 . n. 

Zi-1 

Then  it  follows  from  (3.2)  that  the  Y^'s  are  iidrv's  with  the  simple  expo¬ 
nential  distribution  and 

(3.4)  E0(Yi)  =  Q(9),  Var0(Y.)  =  Q2(0),  i  =  l,...,n. 

Now  from  (2.5)  and  (3.1)  one  obtains  for  each  k,  1  <  k  ^  n 
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(3.5) 


pe«(k).">  ■ 


and  therefore  from  (2.9)  we  get  for  any  k,  1  £  k  S  n 


(3.6) 


k  * 


?n,k  i=lCn,i' 


Where  Ci  =  M  aogq0(Zi|Bn>i_i)),  i  =  l,...,n. 


Hence  from  (3.2)  and  (3.3),  this  gives  us 


n,i 


(3.7) 


-  .Q...(^  1  /y  _  0(6)) 

q2(0)  '  i 


Employing  (3.4)  and  the  relation  in  (3.6)  it  also  follows  directly  that 

1 2 


(3.8) 


I„,,n<9>  "  ViiniEe(<!ll8n,i-l»  *  (w)' 


w- 


Therefore  combining  (2.12),  (3.7)  and  (3.8)  the  process  W  reduces  to 

(3.9)  ”  -  1x7  "  * 


W  (t;0)  =  (E  (x  ))  2  ,E  (Y.  -  Q(0))/Q(0). 
n,T  o  n  l— x  l 


-i 


Note  that  we  are  holding  0  fixed  in  0.  Since  n  x  -►  a  in  P  -probability , 

n  0 


-1. 


by  assumption,  we  have  n  Eq(t  )  -►  a.  Then  since  the  (Y.  -  Q(0))/Q(0)  are 

on  i 


iid  variables  with  zero  mean  and  variance  unity  we  obtain  the  desired  result 
(2.15)  by  an  application  of  Donsker's  Theorem.  (See  Billingsley  (1968)). 
Observe  that 


(3.10) 


Tn  ft. 


n 


M  ■  lJlK  <Zi  I  Bn>1_!> 


n 


where  0  ,  0  e  0  and  0  is  given  by  (2.6).  Assume  for  the  moment  0  =  R, 
n  0  n 


i.e.  a  =  -OT,  b  =  +°°.  Now  for  each  i,  1  <  i  <  n  we  have  from  (3.2) 
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(3.11) 


\<21lEn.i-i)  Q(60)  Ajce^)  -  Q(e0)\ 

Vzii6„.i-D  "Q<v  “p  l  )  1 


and  therefore 


Q(0  )  "  QOn)  Tn 

(3-12)  l0g/Vn,T  (U)  =  —  V  r  i=l(Yi  "  Q(90))/Q(90) 

n  n 

»  {  Q<en>  '  °8  «vj  ■ 

But  Q(6n)  =  Q(0q)  +  un  where  l9n“®o^  ~  !u!n  ^  and  furthermore 

by  the  continuity  of  Q  and  Q' 


(3.13) 


Q(0n)  -*•  Q(0q)  »  Q’(0n)  +  Q'  (0Q)  • 


Hence  the  first  term  on  the  right  hand  side  of  (3.12)  can  be  rewritten 


(3.14) 


un  i5{Q,(0*)/Q(0n)>.T£1(Yi  -  Q(6O))/Q(0O)- 


Again,  since  n  t  ->  a  e  (0,1)  in  Pa  -probability  and  the  (Y.  -  Q(0n))/Q(0n) 
n  a  q  1  u  u 

are  iidrv's  with  mean  zero  and  unit  variance  it  follows  that,  under  the 
probability  measure  P 


(3.15) 


C„  -  -  t(°0»,W0>  V> 


where  £  is  a  standard  normal  variable.  So  in  view  of  (2.14),  (3.13)  and 


(3.15)  the  entity  in  (3.14)  converges  weakly  (under  P  )  to  uj*(0  )£. 

60  °  0 

To  analyze  the  second  term  on  the  right  hand  side  of  (3.12)  we  proceed 

as  follows.  Let  x  (u)  =  un  ^Q'(0  )/Q(6  ).  Now 
n  n  u 
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Q(9)  -  Q(0n)  Q(9  ) 

n  u  ,  n 

-  -  log 


QCen> 


«V 


=X  (1  +  X  )  log(l  +  X  ) 

n  n  n 


=x(l+x)^-x  +  -  (log(l  +  x  )  -  x  +  hx^) 


=  -%x2 (1  +x)  1(1  -  X  )  -g  ,  where 
n  n  n  n 


(3.16) 


g  =  g  (u)  =  log(l  +  x  (u))  -  x  (u)  +  ^x2(u). 


n  n 


From  (3.13)  and  the  definition  of  x  (u)  we  have  at  once  x  (u)  -+  0  for 

n  n 

each  u  e  R.  Furthermore  from  the  elementary  inequalities 


(3.17) 


x3/3(l  +  x)  <  log(l  +  x)  -  x  +  %x2  <  x3/3,  x  > 


we  also  have  that  ng  (u)  ->  0  for  each  u  e  R.  Therefore  since  n  t  ->  a 

n  n 


in  P  -probability  we  get 
0O 


(3.18) 


Tn  (  Q(0n)  108 


Q(en^  2 

W!)  "  ^  VV  +  °P(1) 


and  thus  we  have  shown 


(3.19) 


logA  (u)  -y  {uj^(0  )£  -  *su2J  (0.)}  =  logA(u) 
"  -  w  a  U  at) 


n.T 


for  each  fixed  u  e  R.  Of  course  when  0  =  (a,b),  a,b  finite  (3.19)  continues 

to  hold  for  the  process  A  defined  in  (2.8).  It  also  follows  from  (3.19) 

n,Tn 

that  the  finite  dimensional  distributions  of  the  process  A  converge 

n,Tn 

weakly  to  those  of  A.  Therefore  to  complete  the.  proof  of  Theorem  2  we  need 

only  verify  that  A  is  tight.  To  demonstrate  this  it  suffices  to  show 

n’Tn 

that  for  any  L  >  0 

(3.20)  E  (A**  (u  )  -  hi  (u  ))2<  K(u.  -  u  )2, 

90  n’Tn  1  °’Tn  2  1  2 

for  all  u^>u2  fc  and  some  constant  K  >  0  not  depending  on  u^.u^ 
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or  n.  However,  since  E„  (A  (u)) =  1  for  u  e  (a  ,b  )  and  in  view  of 

°0  n,Tn  n  n 

(2.8)  we  need  verify  (3.20)  for  arbitrary  U^»U2  e  (an>bn)  n  Now 

for  u^.u^,  with  <  u^ 


O.Ji)  E  (Aj,t  (Uj) 
0  n 


‘  -r-  '  0 ' 

n,x  / 
n 


n 

k£l 

[t  =k) 

(po  <2°°-n>  - 

n,  1 

h 

P0  ? 
n,  2 

n 

— In 

and 

0  . 

=  0n  +  u  n  ,  i 

=  1,2. 

n,i 

0  i 

.00 


Further  for  each  k,  1  $  k  S  n,  by  the  Schwarz  inequality 
(3.22) 


/  h  ,  (k)  .  h  ,  (k)  . .  2 

r  n(P0  !(~  >n)  ‘  Pe  ’n))  dpk 

[  t  — k  \  n ,  1  n ,  2 

n 


,0  - 

J[Vk3  2 


n,l  3pc 


ae 


Pa  du(o) 


£  1/ 4[ 0  .  -  0 

n,  1  n,  2  U 


n,  1 


dy(0) 


n,2 


[t  =k] 
n 


P9  ('SO  I  J:'l 


Therefore,  since  Q'(0)/Q(O)  is  bounded  on  0  we  have  from  (3.8)  and  (3.22) 

2  2 

that  the  right  hand  side  of  (3.21)  is  dominated  by  K  (u^  -  u^)  / 4,  where 

K  =  sup(Q' (0)/Q(O) ) •  This  completes  the  proof  of  Theorem  2. 

From  our  analysis  of  the  process  A  we  also  find  that  for  each 

n,T 

(e) 

e  >  0  the  finite  dimensional  distributions  of  the  process  A  converge 

n,Tn 

weakly  under  P  to  the  corresponding  finite  dimensional  distributions  of 

°  .(e). 

A.  Thus  once  again  we  are  left  with  verifying  the  tightness  of  A  in 

n’  n 

Cq(R) .  To  this  end  we  follow  Ibragimov  and  Khas 'minskii  (1972,1975)  and 
establish  two  preliminary  lemmata. 

Lemma^l.  For  each  0  e  G,  n  >  1 


°'23)  4t4l[e+h 

'  n 


-  Pp(z(k)  ,n)J  duk  =  ^  Jn^T  (0)  +  o(h2) 


as  h  -►  0. 


r 


Proof .  Write  M(h)  for  the  expression  on  the  left  hand  side  of  (3.23). 
Following  the  usual  argument  as  in  (3.22)  we  have 

h  f9+h 

M(h)  <  4  j  Jn  t  (e)dy(e). 

and  so  from  (3.8)  we  arrive  at 


lim  h  2M(h)  <:  1/4J  (0). 

h-K)  n,Tn 

To  obtain  the  reverse  inequality  we  use  Fatou’s  lemma. 


^  *  kll 


-il  5pe^2 


j[t  =k]  /  Pq  V  36 
n 


dy,  =  1/4 J  (0), 
k  n,x 

n 


and  hence  (3.23)  is  proven. 


Lemma  2.  Under  the  conditions  placed  on  the  sequence  {t  }  in  Theorem  3, 
for  any  K  >  0  there  exists  constants  c1>c2  >  0  and  an  inCe8er  nQ  -  1 
such  that 


(3.24)  P„  [A  (u)  >  exp(-c  u  )]  <  c  exp(-c.u  ) 

0„  n,  x  1  2  1 

0  n 


whenever  u  S  Kn  and  n  >  n 


O’ 


Proof.  In  view  of  (2.8)  we  may  confine  attention  to  u  e  (a  ,b  ) .  Now 

n  n 


2  2  ^ 

PQ  fAn  t  (u)  >  exp (-c^u  )J  5  exp(^c^u  )<p^  where  =  EQ  (A^  ^  (u)).  Since 


E„  (A  (u))  =  1  we  have  from  Lemma  1 

y  n  n ,  T 

0  n 


(3.25) 


cp  =  1  -  l/8u2n  _  (G„)  +  o(u2/n). 


n,x  0 
n 


-1 


Now  n  J  (G„)  ->■  J  (0„)  as  n  »»  and  so  for  some  integer  n„  £  1, 
n,T  0  a  0  U 

_  i  a  a 

n  J  (0_)  >  hJ  (Q_)  whenever  n  i  n_,.  Also  there  exists  K  >  0, 
n,  t  0  a  0  0 


*  S, 


2  2 

sufficiently  small  such  that  |o(u  / n) |  <  (u  /32)J^(0q),  whenever  |u[  <  K  n' 


it  *  i 

Hence  for  any  u  satisfying  |u|  <  K  n  with  n  >  n 


we  obtain  from  (3.25) 


12 

2  J  <9n>  9 

«Vi  *  (1  “  32"  W  S  exp("  32^~  U  > 

and  so  (3.24)  follows  by  choosing  =  1  and  >  0  appropriately. 

Suppose  K  n  5  ju|  <  Kn  ,  with  K  >  0  arbitrary.  Note  that 

{ k^k=l  a  nonne8ative  supermartingale  under  PQ  so  that  under 

condition  (a)  of  Theorem  3,  viz  t  >  Cn6]  a.s.  (P  )  for  some  C  <65  a, 

n  eQ 

we  get 

(3.26)  <Pn  -  >-  *  Y^CnJ))  *  C.pCun^))^53 

where  tp(x)  =  2^Q(8O)Q(0O  +  x)/(Q (0Q)  +  Q(0q  +  x) ) .  Since  tp  is  continuous  in 

x  and  cp(x)  <  1  whenever  x  ^  0  we  have  tp.  =  sup  ^  tp(x)  <  1  and  therefore 

x  e  [K,K] 

26 

tp  <  exp(-[n6]  jlogtp  |)  <  exp(-  |logcp  | ) , 

2K 

for  all  n  sufficiently  large  and  again  (3.24)  follows.  Finally  if  condition 
(b)  of  Theorem  3  holds,  we  obtain 

tpn  ^  E  (A^  I (t  >  [n(a  -  6)]))  +  E  (Aj*  I(t  /n  -  a  <  -  6)) 
n  0O  n,Tn  n  eQ  n,Tn  n 

(3.27)  5  (cp(un~S2))I'n(a~<5)]  +  A6n/2 

2  2 

<  exp(-  -u-C“-~ij..|i0gCp i  |)  +  A  exp(_  r|log6|), 

2K  2K 

for  large  enough  n  and  this  leads  us  to  (3.24).  This  completes  the  proof 
of  the  lemma. 

The  remainder  of  the  proof  follows  Ibragimov  and  Khasminskii  (1972) . 

k 

In  view  of  (3.20)  and  Lemma  2,  for  any  e  >  0  and  0  <  £  <  en2 

(3.28)  P  C  sup  | A1*  (u.)  -  (u_)|  >  h1/4]  <  ch5 

er.  1.  n,X  1  2  1 

0  |u1-u2]<h  n  n 

|u±  i< 

for  some  constant  c  >  0,  and  for  arbitrary  n  >  0,  there  exists  a  >  0, 
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such  that 


(3.29) 


lim  P.  [  sup  ,  A^  (u)  >  n)  “  0 
n-*®  0  a<|u|<en^  n,Tn 


Then  the  tightness  of  A'  in  Cn(R)  follows  from  (3.28)  and  (3.29). 

n,i  u 

n 

A.  Some  Remarks  and  Examples:  (a)  The  one-parameter  processes  A  and 

/  \  *11 
A'  of  Theorem  2  and  3  are  those  usually  encountered  in  practice.  For 
n’Tn 

the  sake  of  completeness  however,  we  mention  here  briefly  the  two-parameter 
process  (A  ,  . (u) ;  t  c  [0,1],  u  e  R),  defined  in  the  usual  way  for 

n’  nU;V 

u  c  (a  b  )  and  set  constant  (>  0)  otherwise,  keeping  the  sample  paths 
n,  n 

continuous  in  u.  Note  that  throughout  9^  is  held  fixed  in  0.  With  these 
definitions  it  is  not  too  difficult  to  see  that  the  finite  dimensional  dis¬ 
tributions  of  the  process  A  converge  weakly  under  P  to  those  of 

n’Tn  0 

the  process  A  =  (A(u,t):t  e  [0,1],  u  €  R)  where 

A(u,t)  =  exp[uj'S(0_)W(t)  -  %u2tJ  (9„)}. 

a  U  a  u 

In  order  to  obtain  the  weak  convergence  of  the  entire  process  A  we  need 

to  proceed  further.  We  shall  provide  an  outline  here.  Consider  the  space 

D  =  D([0,1]  x  R)  of  all  real  valued  functions  on  [0,1]  xR  which  are  continuous 

from  above  with  limits  from  below  in  the  sense  explained  in  Neuhaus  (1971)  or 

Bickel  and  Wichura  (1971).  For  each  j  £  1  set  =  D([0,1]  x  [-j,j])  and 

let  d.  be  a  metric  on  D.  generating  the  Skorohod  topology  there.  To 
1  3 

define  a  d  consider  the  class  Aq  (respectively  A^)  of  all  strictly 
increasing  continuous  mappings  on  TO,!]  onto  [0,1]  (respectively  on 
[-j,jj  onto  [-j,j]).  Let  A  =  (AQ,Aj)  c  Aq  xA,.  For  any  (t,u)  €  [0,1]  x[-j,j] 
write  j(t,u)j  =  max [| t | , |u | }  and  A(t,u)  =  (AQ(t) , A^ (u) )  .  Then  we  may 
define  d^  by 


JkLi 
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dj(x,y)  =  inf{e  >  0  :  for  some  A  =  (Aq.A^.)  c  A  x  A^  with 

||An||  e,  ||A  ||  <  e,  sup  |x(t,u)  -  y(A(t,u))  |  s  e] 

°  J  (t,u)e[0,l]x[-j,j] 

XQu  -  XqV 

where  ||Xq||  =  sup|log  — —  —  — |  and  ||A .  |j  is  similarly  defined.  Then  the 
t?*s  u  v  j 

metric  d  in  D  given  by 

“  -a  <Mx,y) 

4<k-rt  '  ”  rVdjgsr 

converts  D  into  a  complete  separable  metric  space. 

The  sample  paths  of  A  lie  in  D  and  those  of  A  lie  in  the  subset 

n,Tn 

C([0,1]  x  r)  of  D,  consisting  of  all  continuous  functions  on  [0,1]  x  R. 

To  verify  tightness  of  the  process  A  it  suffices  to  show,  for  each  j  >  1, 

n,Tn 

and  arbitrary  e  >  0 


lim  .  lim 


6^,  6^0  n-M<> 


sup  P9^{sup[  |l°s\,,tn<tl;80) ‘V  -ln«'!n,kri(t2ie0)<u2>l 


:  |u1  -  u2|  <  6^,  |t1~t2|<  62,  li^l  s  j,  t  t  [0,1]]  >  c]  =  0 
To  show  this  we  follow  (3.12)  and  write 

los\.,knU;V<l,)  "  u(n'!5Ee0Ctn)UW^)"n.xn(,;;eo> 

* 

Q  *  ( 0  )  2 

-  ■suVVt;  )  <1  +  V'hl  -  xn) 


-  (n“  kn(t;  60))ngn, 


where  0  ,  x  and  g  are  defined  in  (3.13)  -  (3.16).  The  remainder  of 
n  n  n 

the  analysis  follows  the  usual  conventional  manipulations.  Note  that  the 

tightness  of  W  in  D[0,1]  which  follows  from  Theorem  1  will  be  used. 

n’Tn 

(b)  The  fundamental  assumptions  on  the  sequence  {-t^}  are  that  they  be 

adapted  to  the  o-fields  (8  ,  ;  1  £  k  s  n}  and  satisfy  n  -*  a  e  (0,1] 

n ,  k  n 
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in  probability.  Theorem  3  imposes  a  condition  on  the  rate  of  this  convergence. 

For  example  in  the  simplest  situation  where  sampling  is  terminated  at  time 

t  >  0  we  may  take  t  **  nF  (t),  where  F  (t)  is  the  empirical  d.f.  of 

n  n  n 

T  _ 

X  ,,..., X  .  In  this  case  the  inequality  P„  [  )-=r  -a|  £  6]  £  A^6n,  holds 
n,l  n,n  90  " 

for  some  constants  A  >  0  and  0  <  6  <  1  with  a  =  F  (t).  Gardiner  and  Sen 

6 

(1978)  have  considered  a  wider  class  of  stopping  variables  t  that  are 

n 

expressible  in  terms  of  certain  linear  combinations  of  functions  of  the 
observables  X  ,,..., X  which  is  appropriate  to  this  context. 

(c)  The  restriction  imposed  in  this  paper  to  classes  of  distributions 
satisfying  (2.3)  enables  us  to  work  in  terms  of  independent  variables  even 
though  the  observables  X^  ^,...,X^  ^  are  dependent.  However,  if  this  con¬ 
dition  does  not  hold  results  paralleling  those  given  here  can  be  obtained 
though  the  analysis  is  essentially  different  and  necessarily  more  involved 
as  one  has  lost  the  enormous  technical  facility  of  working  with  independent 
random  variables.  In  particular  the  transformation  (3.3)  cannot  be  made  and 
J  (0)  of  (3.8)  takes  on  a  far  more  complicated  form  even  though  as  n  ->  “* 

n  *  T 

n 

n  (0)  converges  to  a  limit.  Finally,  we  remark  that  randomly  stopped 

",Tn 

likelihood  ratio  processes  can  be  analysed  for  general  dependent  triangular 

arrays  {X  ,  :lsk<:k,n>l}  with  a  different  choice  of  local  coordi- 
n,  k  n 

nates  0  . 

n 
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